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Abstract  - In  this  paper  the  asymptotic  behavior  of  the  discrete  mini- 
mum variance  output  feedback  control  law  is  investigated.  It  is  shown 
that  this  control  law  results  in  an  asymptotically  stable  closed-loop 
system.  For  time  invariant  systems,  the  output  feedback  gain  tends  to 
a periodic  function  of  time  which  is  easier  to  implement  in  the  feed- 
back loop. 
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I.  INTRODUCTION 

Consider  tlie  stochastic  linear  time-varying  system  whose  output  can 
only  be  measured  at  discrete  instants  of  time  and  is  given  by 

Jc(t)  = F(t)x(t)  + G(t)u(t)  + D(t)w(t)  (1) 

y(t^)  = H(t^)x(t^)  + v(t^) 

where  F(t),  G(t),  and  D(t)  are  nxn,  nxr,  and  nxp  continuous  matrices; 
w(t),  the  disturbance  in  the  dynamics  is  a stochastic  process  with  a 
gausslan  distribution  whose  first-  and  second-order  statistics  are 
given  by 

E[w(t)]  = 0;  E[w(t)w'(T)]  = Q(t)6  (t  -t)  (2) 

where  Q(t)  is  a continuous  positive  semidefinite  pxp  matrix  and  6(.)  is 
the  Dirac  delta  function.  Similarly  [v(t^),  i=  0,  1,  ...  ] is  an 
m-dimenslonal  gaussian  white  sequence  for  which 

E [v(tj^)]  » 0;  E [v(t^)v(tj)]  -R(t^)6jj  (3) 

where  R(t^)  is  a positive  definite  mxm  matrix.  The  initial  state  x(t^) 
of  system  is  assumed  to  be  a random  variable  for  which 

E - 0;  E[x(t^)x'(t^)]  - 
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Furthermore  assume  that  for  all  t > t and  t 

o i 


E [ w(t)v'(t^)]  = E [w(t)x'(t^)]  = E [ v(t^)  x'(t^)]  =0  (5) 

Let  the  class  of  admissible  controls  U , be  the  set  of  linear  functions 

c 

of  the  current  output  measurements,  which  is  given  by 

=[ueR*’  = u[t,y(t^)]  = C^(t)y(tp  ; t^ < t < t^^^ , 1=0, 1,  ..N-1  (6) 

Then  It  was  shown  In  reference  [l]  that  the  control  law 

u*(t,y(tp)  = -G'(t)  4. '(t^.t)  W\t^,t^^P  2*(t^H'(tp[H(tp 

r*(t^H'(t^)  + R(tp]  'S(tp  (7) 


where 


2*(ti^l)  =*<'^i+l'ti)  - 2*(tpH'(tp  [H(tp  S*(tpH'(tp 

+ R(tp]  H(t^)  2*(tp]  * (8) 

t 

* r‘^1 

^ <*=o>  + t)D(t)  Q(t)D'(t)d>'(tj^^,t)dt 

S 

W(t^.ti^l)  - / *(t^,t)  G(t)  G'(t)  *'(t^.t)  dt  (9) 


minimizes  the  cost  function 


J(u)  - 1/2  E [x'(t^^j)  ^ “0*  1 N-1  (10) 


subject  to  the  constraints  and  assumptions  (1)  - (6),  provided  that 


W(ti,ti^l)  Is  Invertible. 
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The  objective  of  this  paper  is  to  present  some  of  the  asymptotic  prop- 
erties of  the  discrete  minimum  variance  output  feedback  control  law  (7) 


and  to  show  that  the  resultant  closed-loop  system  is  asymptotically 
stable  in  the  sense  of  Lyapunov.  It  should  be  noted  however,  that  the 
results  developed  in  this  paper,  make  use  of  the  properties  of  the  co- 
variance  equation  (8)  of  the  closed-loop  system,  which  have  been  widely 
investigated  in  the  literature  [2],  [3],  [4]  , and  [s],  in  connection 
with  the  Kalman  filter.  Before  proceeding,  it  will  be  assumed  through- 
out the  following  that  the  assumptions 


(A.l) 

ll♦(t,s)||<0  2(|t-s|)  Vt  and  s 

(11) 

(A.  2) 

0 < 0 < W(  t^ , s 0 2^  ^ 

(12) 

k-1 

(A.  3) 

i=k-N 

< P2I  ^ ® Vk  > N (13) 


-1 

(A.4)  0<Y^I<  Z *'(t^,t^)H'(t^)R  (tpH(t^)*(t^,t|^) 

i«k-N 

Vk>N  (14) 

are  satisfied  for  some  real  o^,  o p2»  and 
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II.  STABILITY  OF  THE  DISCRETE  MINIMUM- VARIANCE 
OUTPUT  FEEDBACK  CONTROL  SYSTEM 

In  this  section  the  asymptotic  stability  of  the  discrete  time  minimum 
variance  closed-loop  system  will  be  investigated  in  the  case  when  no 
noise  or  disturbances  are  present  in  the  measurements  or  the  dyn^unlcs. 
To  be  specific,  let  the  system  under  consideration  be  given  by 

x(t)  =»  F(t)x(t)  +G(t)u(t)  (15) 

y(t^)  = H(t^)x(t^) 

and  let  u(t)  be  given  by 

u(t)  = u*(t,y(t^))=  -G'(t)  4> '(t^,t)w"^(t^,t^^j^)  S*(t^)H'(t^) 

[H(tp  I*(tpH'(tp  + R(tp]'^  y(tp  (16) 

For  this  control  law  the  state  at  the  sampling  times  is  given  by 

x(ti^l)  "*^*'i+l’*'P  - 2*(t^)H'(t^)[H(tp  2*(tpn'(tj_) 

+ R(tp]  "Vtp  } x(tp  (17) 

The  objective  of  this  section  is  to  show  that  starting  from  any  initial 
condition  x(t^),  the  state  of  the  closed-loop  system  (17),  x(tj^)  , tends 
to  zero  as  t^  approaches  infinity. 

* 

Let  P be  given  by 

- 4 - 


P*(t^^l)  = {i:*(tp  - S*(t^)H'(tp  r H(tp 


+ R(tp  ] 'Vtp  E*(tp  } 


Then  it  was  shown  in  references  [2]  and  [3]  that  P is  bounded 
from  above  and  below  for  every  1,  provided  assumptions  (A. 3)  and  (A. 4) 
are  satisfied.  These  results  are  summarized  in  the  following  lemma. 


Lemma  1 : (Deyst  and  Price)  If  assumptions  (A, 3)  and  (A. 4)  are  satis- 

fled,  then  P is  bounded  from  above  and  below  for  every  i by 


/!i  , » 1 


Theorem  1;  Assume  that  (A. 1)  through  (A. 4)  are  satisfied,  then  the 
discrete  time  closed-loop  system  (17)  is  uniformly  asymptotically 
stable  in  the  large  and 


V(x(ti^l)  ,ti^l)  = *'^^i'^i+P^  ^*^i+l^*^*^l’*^i+l^’'^*^i+l^ 


is  a Lyapunov  function,  where  P is  given  (18) 


Proof ; Using  assumption  (A. 1) , it  can  be  easily  deduced  that 


®3  ^ ^ ' ^*"1  ’ *’1+1^***^^1  * ^1+1^  - 1^1+1  " ^1^^  (21) 
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Furthermore,  from  (21)  and  (19)  it  can  be  deduced  that  for  all  t 


v2  -2 
^2°'2 


+ Nvfp,  ^ ^ ^ ^ 


'1^2 


j ( 1 + 2 \ 

1 } I 

Pi  3 


(22) 


Hence  uniformly  bounded  from  above  and  below  for 

every  t^,  i.e.,  there  exist  continuous  nondecreasing  scalar  functions 

<5i  ( II I and  6^[  II  x(t^^^  ||  ] such  that  6^(0)  = 6^(0)  = 0 and 


0<  6i[l|x(t^^.p||l  g V[  x(t^^^),t^^^]  g 6,[  II  II  1 


< OO  Vt, 


(23) 


Hence  (20)  is  a Lyapunov  function.  To  show  that  (17)  is  uniformly 
asymptotically  stable  in  the  large,  we  need  to  show  (6],  that  for  some 
finite  N,  there  exists  a negative  definite  function  ^3^  II ’'^*'1+1^  II  ^ 
such  that  Vt^  > tj^ 


V[x(t^^l).t^^J  ■ V[x(t^_j^),t^_jj]  < 6 [ II  x(t^_^P  II  ] < 0 (24) 


Consider  the  function 

V[x(ti^l) 


.-1 


Substituting  for  x(tj^_j_j^)  from  (17)  we  get 
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=x'(t^2*  \tpx(tp 

*-l 

= x'(t^)Z  (tpx(tp  - x'(t^H'(tp  [n(t.)Z*(tp 
H'(tp  + R(tp]  ‘^H(tpx(tp  (25) 

Since 

Z*(t^)  = Q(tj,  ,t^_P  (26) 


it  follows  that 

2*(t^)  > *(tj^,t^_^)P*(t^)4''(t^,t^_j) 


(27) 


from  which  it  can  be  deduced  that 


,-l 


«l>'(ti.i.ti)P 


.-1 


(ti)*(ti_i,ti) 


(ti) 


(28) 


From  (28)  and  (25)  we  have 


V[x(ti^l).ti^l]  < V[x(tp,tj  - x'(t^)H'(tp  [H(tpZ*(tpH'(tp 


+ R(tp  ] ~^H(t^)x(t^) 


(29) 


Repeating  the  above  for  k - 1-1,  l-N  we  get 
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k—i 


-1 


H'(ti^)  + R(tk)  ] H(tk)x(tk> 


(30) 


From  (26)  we  have 

[R(tk)  + H(tk)  2*(tk)H'(tk)]  = {R(tp  + H(tk)[4>  (t^.  t,,.i)P*(tk) 

*'(tk.tk_i)  + Q ]H'(tk)}  (31) 

and  since  $(tk,tk_j^)P  (t^*  bounded  from  above  for  all  k, 

it  can  be  deduced  from  (31)  that  there  exists  an  tj  > 0 such  that 

[R(tk)  + H(tk)  2*(tk)H'(tk)]  < [ R(tk>  + TjH(tk)H'(tk)  ] < « (32) 

Using  (32)  in  inequality  (30)  we  get 

''[“'W-'i+il  - ''WW’Vn'  " rR(t ) 

k=i 

-1 

+ T]H(tk)H'(tk)l  H(tk)x(tk)  (33) 

Since  (A. 4)  implies  that  (15)  la  discrete  time  observable  and  since 
observability  is  Invariant  under  output  feedback  control  laws,  it  fol- 
lows that  the  right  hand  side  of  (33)  is  strictly  less  than  zf;ro.  Hence 
there  exists  a 5^1  ||  x(t^^^)  ||  ) such  that  (24)  is  satisfied,  from 
which  it  can  be  concluded  that  (17)  is  asymptotically  stable  in  the  large. 

QED 


8 


Remark  1 ; Assumptions  (A. 1)  and  (A. 2)  are  equivalent  to  the  assump- 


tion that  system  (17)  is  uniformly  completely  controllable  and  is 

needed  to  ensure  the  uniform  boundedness  of  the  control  law  (16)  for 

all  t,  and  that  ofW(t.,t.,.)  for  all  i. 

1 1+1 

III.  ASYMPTOTIC  BEHAVIOR  OF  THE  DISCRETE  MINIMUM  - VARIANCE 
OUTPUT  FEEDBACK  CONTROL  LAW 


In  this  section  the  steady  state  behavior  of  the  discrete  minimum  - 
variance  output  feedback  control  law  (16)  is  considered.  The  results 
developed  make  use  of  the  properties  of  the  discrete  matrix  Riccati 
equation,  which  has  been  widely  investigated  in  the  literature  [2]  - 
(51. 

LetZ;  resulting  state  covariance  of  the  closed-loop  system 

for  any  admissible  control 

u(t,y(t^))=  K(t)  y(t^)  (34) 

Then  the  recursive  relation  that  determines  Z (t^),  is  given  by 


Z(ti^l)  [1  + K(tpH(t^)l  Z (tp  (I  + K(t^)H(tpl  ' 

♦’(ti^l.ti)  + $ (t^^^.t^)K(tpR(t^)K(t^)  <I>'(t^^^,tp  + Q(t^,t^^P  (35) 

■ where 


(36) 


9 


! 


I 


I 


and 

K(tp 

Lemma  2 ; Assume  that 

“fc 

Then  the  control  law  u (t,  y(t^))as  given  by  (16)  minimizes  the  state 
covariance  of  the  closed-loop  system  at  the  sampling  time. 

Proof:  We  would  like  to  show  that  for  any  u(t,  y(t^))  eUg 

^(ti^l)  2 2 (t^^^)  i = 0,1,...,N-1  (39) 

* 

where  Z:(t^)  and  Z (t^)  are  given  by  (35)  and  (8)  respectively.  Assume 
for  now  that  for  some  i 


-I 


ti+1 


<I>(t^,t)  G(t)ic(t)  dt 


(37) 


Z(tp  > 2:*(t^)  (40) 

* 

and  let  K (t^)  be  given  by 

K*(t^)  = S*(tpH'(tp(H'(tp  S*(t^)H(tp  + R(tp  ] (41) 


then  it  follows  from  assumption  (40)  that 


10  - 


L'(t^^l)  > $ [I  + K(t^H(tp]  2*(tp  [I  + K(tpH(t^)]' 


» 

i 


-^*^"1+1^  +<f(t^^l,t^)  Z*(ti)H'(tp  fH(tp  l*(tpH'(tp 
+ R(t^)  ] '^H(tp  i:*(tp  * + <I>(t^+l.tpK(tp[H(tp 

i:*(tpH'(tp  + R(tp  ]K’(tp<i>-(t.^^,tp 
+ $ (t^^^,tpK(tpH(tp  S*(tp 

>l*(t^^l)  + fK(t^)  +K*(tp)  [H(tp  I*(tpH'(tp 

+ R(t^  ] f K(tp  + K*(tp  1 ■ 

(42) 


Since  D (t^)  = 1’  (t^)  - assumption  (40)  Is  satisfied  for  t^,  and 

It  follows  from  (42)  that  for  any  u ft,  y(t.)l  cU 

1 c 

z(tp  >2:*(t^) 

and  (39)  follows  by  Induction  on  1. 

QED 
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It  should  be  noted  that  lemma  1 is  a generalization  of  the  results 
presented  In  reference  [1]  , where  it  was  shown  that  u (t,  y(tj^)]  mini- 
mizes the  trace  of  the  state  covariance  at  the  sampling  times. 

A basic  assumption  that  was  used  in  showing  the  optimality  of  u lt,y(tj^)l 

is  the  a priori  knowledge  of  the  initial  covariance  of  the  state  -(t  ). 

o 

In  the  sequel  it  will  be  shown  that  if  assumptions  (A. 1)  through  (A. 4) 

it 

are  satisfied,  then  the  steady  state  behavior  of  iT  (t^)  is  Independent 
of  l(t^). 

• * 

Let  1 -q)  denote  the  optimal  value  of  the  state  covariance 

it  it 

matrix,  starting  from  the  Initial  value  - (t  ) = r , and  let  <1>  (t,.,, 

o o c i+1 

ti>  given  by 


*c^^i+l’*^i’  “o^  ~ ‘*’^’^1+1’*^!^  fl  - K (t^,  rp)H(t^)) 


(43) 


it 

Where  K (t^^,  i.'^)  is  given  by  (41). 

Then  by  simple  matrix  manipulations  it  can  be  shown  that 


4>c(ti+l»*^l»0)  f - ^^i’^o’  “o^  ” “ * c'^*^i+l’^i’®^ 


- “o>  ■ - <‘^i+l*^'°>  ^‘^i*  -o>  ’ 


fH(tp  i:  (tj,t^,0)H'(tp  + R(tpl  [K  (t^,  V^)  - K (t^.O)]  ’ 


(44) 
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from  which  it  can  be  deduced  that 


(45) 


Applying  the  above  inequality  repeatedly  we  get 


Since  assumptions  (A, 1)  - (A. 4)  are  satisfied  it  follows  from  theorem  1, 
that  there  exist  positive  real  numbers  and  such  that 


(46) 


Hence 


11.  J„)  - i*(6,^.,,t^.O}  < 0 (47) 

t -*-co 
o 


But  since  2^  > 0,  It  follows  from  lemma  2 that 

^*<'l+l''^o’  V - = “ Vtj.ndt^  (48) 


From  (48)  and  (47)  it  can  be  deduced  that 
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lim  =0  (49) 

t — --D 
O 

ic  i( 

Since  i , S ) and  S ,0)  are  bounded  from  above  and 

l+i  O O l+i  o 

below  it  follows  that 


11m  t ZJ 

t OO 

O 


lim  S*(t^^^,t^,0)  # 

t — ►-« 

O 


(50) 


Applying  the  above  results  to  the  problem  under  consideration  we  get: 


Theorem  2;  If  assumptions  (A,1)-(A.4)  are  satisfied  then  the  output 
feedback  control  law 

u*(t.  y(t^)  = - G'(t)  4>'(t^,t)  W"^t^,t^^^)  2*(tpH’(tp  {H(tp 

r*(tpH'(tp  + R(tp}  y(tp  (51) 

minimizes 

11m  E {x(t^+l)x'(t^^p}  # 11m  v(t^^^,t^.  r^) 

t — CX3  t —♦•CO 

O O 

subject  to  the  constraints  (1)  - (6). 

Where 
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+ R(t^)  } 


-1 


V (t^)  . 0 


{r*(tp  - i:*(tpH(t^)  {H(c^2*(tpH'(tp 
H'(tp  ^*(ti)}  (52) 


In  the  time  Invariant  case  where  the  output  measurements  are  sampled 
at  a constant  interval  T,  the  matrices  F,  G,  H,  Q and  R are  Independent 
of  time,  it  can  be  shown  (4)  , that 

11.  - 11.  - 2*  (53) 

t -»-C0  t — »-00 

O O 

~ * 

where  2.  is  the  positive  definite  solution  to  the  equation 


V 


* (T)  { 1 


-.rH 


H 2:  H' 


+ R } 


2 * } 4>'(T) 


+ Q 


(54) 


In  this  special  case  assumptions  (A. 1)  > (A. 4)  reduce  to 

(A. 1) ' {f,  g}  is  a controllable  pair 

(A. 2)'  {<I>(T),u}  is  an  observable  pair 

(A. 3)'  {<*>(T),c}  is  controllable,  where  Q ■ CC' 

and  we  have  the  following  theorem: 


Theorem  3;  Assume  that  (A. 1) ' - (A. 3)'  are  satisfied,  then  the  periodic 
output  feedback  control  law 


- 15 


u*(t,  y(kT))  - - G'  4>  '(t,  kT)  w'^(T)  1 *11'  {h2*H'  + r}"^  y (kT) 


I 


i 


kT  < t < (k  + 1)  T,  k = k^,  k^  + 1,..,. 


(55) 


inlnlmizcs 


11m  E {x(kT)x'(kT)  } ^ 11m  V (kT.k^,  v^)  ; (56) 


k -►-CO  k-»-oo 

o o 


where 


W(T) 


/ 


G G'  dt 


(57) 


and  Is  the  positive  definite  solution  of  the  matrix  equation  (54). 


Furthermore  the  resultant  closed-loop  system  Is  asymptotically  stable 
In  the  sense  of  Lyapunov. 

The  proof  of  the  above  theorem  Is  similar  to  that  of  theorem  2 and  hence 
will  be  omitted. 


I 

I 


I 
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IV.  CONCLUSION 


The  discrete  minimum  variance  output  feedback  control  law  considered 
in  this  paper  results  in  an  asymptotically  stable  closed-loop  system. 
Hence  besides  its  optimality,  this  control  law  can  be  used  in  stabili- 
zing linear  systems  by  output  feedback.  The  assumptions  that  were 
made  in  establishing  the  asymptotic  properties  of  the  control  law  are 
standard  ones.  Under  these  assumptions,  the  control  law  minimizes  the 
steady  state  value  of  the  state  covariance  at  the  sampling  times,  re- 
gardless of  the  assumed  value  of  the  system  initial  state  covariance. 
In  the  time  invariant  case,  the  output  feedback  gain  approaches  a 
periodic  function  of  time,  which  is  easier  to  compute  and  Implement. 
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